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Bayesian Hypothesis Testing 


9.1.8 Bayesian Hypothesis Testing 


Suppose that we need to decide between two hypotheses Hq and H i. In the Bayesian setting, we assume that 
we know prior probabilities of Hq and H\. That is, we know P(Hq) = Pq and P(H\) = p\ , where 
PQ + Pi = 1. We observe the random variable (or the random vector) Y. We know the distribution of Y 
under the two hypotheses, i.e, we know 

f Y (y\Ho), and fy(y\Hi). 

Using Bayes' rule, we can obtain the posterior probabilities of Hq and H \: 


„ , f Y (y\H 0 )P(H 0 

Y = v) = -Ms/) 

, fr(y\HQP(H 1 

Y=y)= m 

One way to decide between Hq and H\ is to compare P(Hq \Y = y) and P(H\ \Y = y). and accept the 
hypothesis with the higher posterior probability This is the idea behind the maximum a posteriori (MAP) test. 
Here, since we are choosing the hypothesis with the highest probability, it is relatively easy to show that the error 
probability is minimized. 




To be more specific, according to the MAP test, we choose Hq if and only if 

P(Hq\Y = y) > P(Hi\Y — y). 

In other words, we choose Hq if and only if 

f Y (y\H„)P(H 0 ) > My\HQP(HQ. 

Note that as always, we use the PMF instead of the PDF if Y is a discrete random variable. We can generalize 
the MAP test to the case where you have more than two hypotheses. In that case, again we choose the hypothesis 
with the highest posterior probability. 

MAP H y pothesis Test 


Choose the hypothesis with the highest posterior probability, P(Hi Y = y) . Equivalently, choose hypothesis 
Hi with the highest fy (y\Hi)P(H{). 


Example 9.10 

Suppose that the random variable X is transmitted over a communication channel. Assume that the received 
signal is given by 


Y = X+ 

where W ~ X(0, (T“) is independent of X. Suppose that X = 1 with probability p, and X = — 1 with 
probability 1 — p. The goal is to decide between X = 1 and X = —1 by observing the random variable Y. 
Find the MAP test for this problem. 

• Solution 
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o Here, we have two hypotheses: 


H 0 :X=1, 

H\ . X = -1. 

Under Hq,Y = 1 + W. so Y Hq ~ AT(1, cr 2 ). Therefore, 


Mvl^o) = 




fa-i ) 2 

e 2 t 2 


Under H\,Y = — 1 + VP so Y | ip ~ iV( — 1, cr 2 ). Therefore, 


Mwlffi) = 


r\/27r 


fa+l)2 

e 2.2 


Thus, we choose #0 if and only if 


fa-i) 2 i fa+ir 

:e 2(7 2 P(if 0 ) > -—^e 2.2 


cry/2 tt 

We have P(Hq) = p, and P{H\ ) = 1 — p. Therefore, we choose Hq if and only if 


( 2y \ > 
exp — > 


1 -P 
P 


Equivalently, we choose Hq if and only if 


(J“ . / 1 — p 


y > - 7 u ln , 

2 vp 


Note that the average error probability for a hypothesis test can be written as 

P e = P {choose Pi|P 0 )P(P 0 ) + P(choose H 0 \Hi)P(Hi). (9.6) 

As we mentioned earlier, the MAP test achieves the minimum possible average error probability 


Example 9.11 

Find the average error probability in Example 9.10 
• Solution 

o in Example 9.10 . we arrived at the following decision rule: We choose Hq if and only if 

y>c, 


where 


https://www.probabilitycourse.com/chapter9/9_1_8_bayesian_hypothesis_testing.php 


2/5 















9/18/2018 


Bayesian Hypothesis Testing 


<J“ , / 1 — p 


c = —In 
2 


P 


Since Y\Hq ~ iV(l,t7 2 ), 


P (choose Hi|H 0 ) = P(y < c|H 0 ) 


Since y|Hi - N(—l, a 2 ). 


= $ ( —In I 


1 ~P 

P . 


P(c hoose H 0 |Hi) = P(F > c|Hi) 


1 

cr 


= 1-4 I -In| 


1 

P , 


1' 

a 


Figure 9.4 shows the two error probabilities for this example. Therefore, the average error 
probability is given by 

P e = P (choose Hi|H 0 )P(H 0 ) + P(choose H 0 |Hi)P(Hi) 

/ O’ 


= p-$ ( -ln| 




'-•HtH 
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Figure 9.4 - Error probabilities for Example 9.10 and Example 9.11 


Minimum Cost Hypothesis Test: 

Suppose that you are building a sensor network to detect fires in a forest. Based on the information collected by 
the sensors, the system needs to decide between two opposing hypotheses: 


H 0 : There is no fire, 
H \: There is a fire. 
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There are two possible types of errors that we can make: We might accept Hq while H\ is true, or we might 
accept H\ while Hq is true. Note that the cost associated with these two errors are not the same. In other 
words, if there is a fire and we miss it, we will be making a costlier error. To address situations like this, we 
associate a cost to each error type: 


CiO: The cost of choosing H\ , given that Hq is true. 

Cq\ : The cost of choosing Hq . given that H\ is true. 

Then, the average cost can be written as 

c = CioPtchoose H 1 \Hq)P{Hq) + choose 

The goal of minimum cost hypothesis testing is to minimise the above expression. Tuckily, this can be done 
easily. Note that we can rewrite the average cost as 

C = P (choose H^Ho) ■ [P(Hq)C 10 ] + P(choose Hq\H{) • [P(i2i)C 0 i]. 

The above expression is very similar to the average error probability of the MAP test (Eq uation 9.6 1. The only 
difference is that we have p(Hq)C\q instead of P(Hq). and we have p(H\)Cq\ instead of P{H \). 
Therefore, we can use a decision rule similar to the MAP decision rule. More specifically, we choose Hq if and 
only if 


fY(y\Ho)P(H„)C m > / F (2/|-Hi)P(-ffi)Coi (9.7) 

Here is another way to interpret the above decision rule. If we divide both sides of Eq uation 9.7 by fy (j/) and 
apply Bayes' rale, we conclude the following: We choose Hq if and only if 

P(H 0 \y)C w > P(Hi\y)C 0 i. 

Note that P^Hq \y)C\Q is the expected cost of accepting H\. We call this the posterior risk of accepting H\. 
Similarly, P(H\ 1j)Cqi is the posterior risk (expected cost) of accepting Hq. Therefore, we can summarize 
the minimum cost test as follows: We accept the hypothesis with the lowest posterior risk. 

Minimum Cost H y pothesis Test 


Assuming the following costs 


Ciq : The cost of choosing H\ , given that Hq is true. 

Cq\ : The cost of choosing Hq, given that H\ is true. 

We choose Hq if and only if 

My\Ho) ^ P(HQC m 
fr(y\HQ - P(H 0 )C m ' 

Equivalently, we choose Hq if and only if 

P(H 0 \y)C w > P(Hi\y)Coi. 


Example 9.12 
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A surveillance system is in charge of detecting intruders to a facility. There are two hypotheses to choose from: 


Ho : No intruder is present. 

H i: There is an intruder. 

The system sends an alarm message if it accepts H\ . Suppose that after processing the data, we obtain 
P(H\ y) = 0.05- Also, assume that the cost of missing an intruder is 10 times the cost of a false alarm. 
Should the system send an alarm message (accept H\)l 

• Solution 

o First note that 


P{Ho\y) = 1-PiH^y) = 0.95 

The posterior risk of accepting H\ is 

P{Ho\y)Cio = 0.95Cio. 

We have Cq\ = IOC 10 , so the posterior risk of accepting Ho is 

P{Hi\y)Coi = (0.05)(10Ci 0 ) 

= 0.5(710. 

Since P(Ho\y)C\o > P(Hi\y)Coi , we accept Hq , so no alarm message needs to be sent. 


<— previous 
next —* 
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